Online test administration results in students selecting more responses to multiple-choice-multiple-response items

We developed the Physics Inventory of Quantitative Literacy (PIQL) to assess students’ quantitative reasoning in introductory physics contexts. The PIQL includes several “multiple-choice-multiple-response” (MCMR) items (i.e., multiple-choice questions for which more than one response may be selected) as well traditional single-response items. In this paper, we discuss differences performance on MCMR that seems result from administration method (paper versus online). particular, find a tendency “clickiness” online administration: students choose responses when taking electronic version assessment. Student was not affected by method. These results suggest provide unique opportunity probe and on-paper low-stakes assessments.Received 22 August 2022Accepted 20 December 2022DOI:https://doi.org/10.1103/PhysRevPhysEducRes.19.013101Published American Physical Society under terms Creative Commons Attribution 4.0 International license. Further distribution work must maintain attribution author(s) published article’s title, journal citation, DOI.Published SocietyPhysics Subject Headings (PhySH)Research AreasAssessmentInstructional strategiesTechnologyPhysics Education Research